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What is claimed is: 

1 . A method of displajjing motion guidance cues, namely the annotated "sliding" 
ghost metaphor. In addition to showing a computer character dance according to the motion 
(or dance) data, for any given time instance (say at t = tl), few frozen future motion frames 
(drawn as a transparent ghostly figurfe) of tl + kl *At, tl + k2* At, tl + k3* At, tl + k4*At, . . . 
tl + kn*At are shown beside the main character as well. The ghosts are drawn at a fixed 
distance from the main character proportional to how advanced in time of frame it represents. 
Therefore, as time progresses, each frozen ghostly frame is seen as approaching toward, and 



finally merging into, the main frame. 

The number of frozen frames qisplayec 
of basic time increment At is user setdple (ug 
are set (by the developer) so that the frcjzen^ 
a particular motion. These frozen moti^n/fram 



(the value of n), values of ki's and the amount 
ally n = 3 and At = 0.5 second). Usually, ki's 
es represent important "key postures" during 
s of slight future are used as cues to remind 



players the next dance/stance/motion to perform/take. 

Key postures may be augmented with short texts/audio display (located in the lower 
part of the screen underneath the maim character) to further inform the player of the 
next/current dance (motion) segment to perform (e.g. "hands up!", "disco time", etc.). The 
key postures and annotated texts/sounds are designated using a separate management tool 
preferably by the motion expert (e.g. dancer) and saved in a separate file. The motion of the 
player is captured by tracking five specific positions on the player's body (its mechanism to 
be explained later). These are the two wrists, two ankles and the belly. To give feedback and 
inform the player of how well one is followinguhe motion on the screen, whenever the 
player's tracked positions fall within a threshold value of where it should be, the 
corresponding positions on the animated figure are\ highlighted with special effects (e.g. 
exploding lights) and is given commendation (e.g. "perfect", "excellent", "good", etc.). 
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2. A method of approximately tracking user's motion or collecting motion data 
in real time by both employing history based prediction and taking advantage of the reference 
motion data. At the beginning of the dance or motion, the player takes a known posture in 
order to initialize the marker's position. Thereafter, markers are tracked by using the 
marker's profile history, namely their travel direction, velocity and acceleration. To reduce 
image processing time, small windows for searching markers within are opened around 

users make abrupt motions and thereby violate the 



predicted marker positions. When 
prediction principle, the markers wil 
window). After a few frames of emp^y searc 
new positions predicted by the origina 
from their course as predicted by the oHgim 
a "switched" marker problem has occurrea and 



be "missed" (markers are not present in the search 
windows, the prediction windows are reset at 
lata. When tracked markers deviate too much 
otion, search windows are reset assuming that 
the player is making an attempt to follow the 



motior 



n 



original motion. Such a prediction baspd approach reduces the computational cost and thus 
the overall hardware cost. 

3. A method of evaluating the motion of a game player by making a frame by 
frame comparison of the 3D position datatof the important body positions. When a marker is 
missed, it can be interpreted as having t©o much deviation from the predicted path, thus 
resulting in a low score. In order to overcome the "offset" problem, where the player has 
managed to follow the motion qualitatively, but off the center position (thus resulting in a low 
score), a simple compensation can be made by monitoring the player's offset from the enter 
position. The offset is computed by estimating the center position of the player as being at 
the midpoint of one's two ankles (tracked by tha cameras). Tracking the belly marker for this 
purpose is an unreliable method because it often gets confused with the passing wrist 
markers. The "delay" problem, in which the player is slightly late in following the motion, 
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1 can be overcome by applying "tinie shifts", by fitting the player's motion data to that of the 

2 original motion data at nearby criftcal points. 
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